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METHOD AND APPARATUS FOR RE-FORMATTING WEB PAGES 

This is a continuation-in-part of co-pending U.S. Patent Applications: S/N 
09/098,670, filed on June 17, 1998; and S/N 08/970,735, filed on November 14, 
1997, both incorporated by reference into this specification. 

BACKGROUND OF THE INVENTION 

The present invention relates generally to a client-server technology and more 
particularly to a client-server system with the application delivered to the client being 
automatically modified based on the resources available. 

A server computer may deliver applications to many different types of clients 
through many different types of media. For example, the server can be delivering a page 
to a printer through a cable, a note to a pager through radio waves, an audio message to a 
cellular phone through microwave, a web page to a Internet enabled computer or a palmtop 
through infrared radiation, a movie to a television through optical fibers, or an on-off 
command to the switch of a microwave oven or the central air-conditioning system of a 
house through twisted pairs. 

Each of these clients or appliances have different capabilities. Some of them can 
have relatively powerful microprocessors^and memory capacity, such as a palmtop. Others 
can be ultra-thin clients with minimal computation and memory power, such as a television. 
The delivery media can be very different. For example, some have large bandwidth, such 
as optical fibers; but others have low bandwidth, such as twisted pairs. Also, the 
applications can be quite diverse. For example, a movie requires large bandwidth, low 
latency, and is quite tolerant to error rates; but an on-off command to a switch has to be 
absolutely accurate, though the bandwidth requirement is low. 

There is typically a specific approach to deliver each type of application through a 
specific medium to a specific client. For example, if you want to print a page, you will 
activate a specific printer driver to print that page; and if you want to send a web-page to 
your Internet enabled computer, your web-page is compressed by a certain pre-determined 
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ratio and is transmitted following a specific network protocol. Different software programs 
are called by the server to accomplish such diverse tasks. 

Whether an Internet enabled computer or a television requests for an interactive 
application, which is an application that you can interact with, such as a web-page, the 
server typically follows the same preset network protocol to deliver the interactive 
application. In other words, if, for example, the transmission medium is changed after the 
protocol is preset, the server does not have the intelligence to modify the protocol 
dynamically in view of the change. There is no intelligent adaptability on the part of the 
server. The server would not know or would not care that a user is sitting one foot away 
from the web-page on the Internet enabled computer, or is sitting six feet away from the 
web-page on the television. 

Not only does the server lack adaptability, the server would not be able to respond 
to certain requests from certain clients. For example, the application is a push application, 
which is an application determined by a user based on her profile, such as quoting the stock 
price of XEROX at 1 PM everyday. A server would not be able to respond automatically 
to both a pager requesting for a stock quote, and a standard telephone requesting for a 
weather report. The way it is typically done nowadays is to have a separate server 
dedicated to handle each of these tasks. 

It should be apparent from the foregoing that there is still a need for an apparatus 
and method to automatically handle such diverse applications, client capabilities and 
transmission media, such that different applications can be automatically modified based 
on the resources available from the transmission media and the clients. 

SUMMARY 

The present invention is on methods and apparatus that automatically modify an 
application in view of one or more of the following: the application, and the capability of 
the client requesting the application and the transmission medium delivering the application. 
The client can be a palmtop computer showing your new appointment of the day, a 
microwave oven automatically being turned on at 6 PM to cook your chicken, or a 
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television showing your favorite James Bond movie. Each of these clients has different 
capabilities connected to different transmission media, and each application has its 
characteristics. Based on this invention, the server computer automatically modifies the 
specific application in view of the resources available so as to maximize the benefits of the 
resources. 

In one embodiment, the application can be of an interactive type, such as a web- 
page, which a user can interact with. This embodiment includes a server apparatus in a 
server. The server apparatus includes an appliance-specific transducer and an adaptive 
transmission transducer. The appliance-specific transducer, in view of a client's request for 
an interactive application in the server, is configured to modify the application based on the 
client and the application to generate an appliance-specific output. This output is modified 
automatically depending on the client and the application itself. The adaptive transmission 
transducer, which is coupled to the appliance-specific transducer, is configured to modify 
the appliance-specific output. The modification is again based on the application and the 
corresponding medium of transmission. After the modification, an adapted output is 
generated, and is delivered through the medium to the client. Then, the client decodes the 
adapted output to produce a modified version of the interactive application that is adapted 
for the client. 

In another embodiment, the application can be of a push type. A push application 
is an application that is pre-determined by a user, such as from the user's profile. Based 
on her preference, as shown in her profile, specific applications can be delivered to her. 
For example, during weekends, she prefers to wake up at 9 am, and she likes music by the 
Beetles. So at 9 am every Saturday and Sunday, the server selects a song by the Beetles, 
compresses it, and delivers it to her speaker next to her bed for fifteen minutes. This 
embodiment also includes a server apparatus, with its corresponding appliance-specific 
transducer and adaptive transmission transducer. 

Yet another embodiment includes a client apparatus in a client. The client apparatus 
includes a decoder for generating the modified version of an application from an adapted 
output. The adapted output is generated by one of the above described appliance-specific 
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transducer and adaptive transmission transducer 

Based on the present invention, applications are automatically mapped onto various 
clients based on the resources available. In one embodiment, the resources include the 
bandwidth, acceptable error rates, and the latency of the transmission medium, and the 
5 processing power and memory capacity of a client. 

With the present invention, different types of clients can be connected through the 
same transmission medium, such as a high speed Internet connectivity. The server can 
modify the applications based on the clients receiving them and based on the applications. 
Also, with the present invention, different types of clients can be connected through 
10 different media, such as wired and wireless, digital and analog; and the server can adapt 
the applications accordingly. 

The client can be ultra-thin, with minimal computing power and memory capacity 
because the server has already adapted or modified the application for the client. In other 
words, the client can be a very low-cost device. 
15 Moreover, since applications can be modified by the server to fit specific clients, 

the same content materials can be used for different clients. For example, the present 
invention can use the same Internet content for an Internet enabled computer and a 
television. And these contents can be delivered to different clients in real time. 

With the present invention, development time to adapt different applications to a 
20 new type of client can be significantly reduced. Changes can be done through software 
modification based on the present invention. This, in turn, significantly enables widespread 
deployment of a new type of client into the market place quickly. 

Another embodiment of the present invention includes a customization tool to re- 
format a pre-determined rendition of contents, such as a Web page, for specific classes of 
25 devices, based on preferences of content providers or end users or both. 

Note that the language used in the specification has been principally selected for 
readability and instructional purposes, and may not have been selected to delineate or 
circumscribe the inventive subject matter. Also, the features and advantages described in 
the specification are not all-inclusive. Other aspects and advantages of the present invention 
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will become apparent to one of ordinary skill in the ait, in view of the specification, which 
illustrates by way of example the principles of the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 shows examples of applications applicable to the present invention. 

FIG. 2 shows an example of the server side and the client side of the present 
invention connected through a transmission medium. 

FIG. 3 shows one set of steps to implement one embodiment of the invention. 

FIG. 4 shows examples of appliance-specific transducers in the present invention. 

FIG. 5 shows one embodiment of the adaptive transmission transducer of the 
present invention. 

FIG. 6 shows examples of the characteristics of transmission media for the present 
invention. 

FIG. 7 shows examples of ways to select the compression algorithms based on the 
computation power of the client and the input data type in the present invention. 

FIGS. 8A-B show examples of network protocols selected by the adaptive 
packetizer under different conditions in the present invention. 

FIGS. 9A-B illustrate an example of a decision tree of the present invention for a 
Web browsing application. 

Same numerals in Figures 1-9 are assigned to similar elements in all the figures. 
Embodiments of the invention are discussed below with reference to Figures 1-9. 
However, those skilled in the art will readily appreciate that the detailed description given 
herein with respect to these figures is for explanatory purposes as the invention extends 
beyond these limited embodiments. 

DETAILED DESCRIPTION OF THE INVENTION 

The present invention is applicable to a server-client environment. The server can 
be connected to one or more clients through the corresponding transmission media. The 
server can be a personal computer or other types of computers, typically with more 
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computation power and memory than the clients. The clients can be many different types 
of computing engines; for example, they can be an Internet enabled computer, a television, 
a palmtop, a microwave oven, a telephone, or a pager. Thus, the capabilities of a client 
can be quite flexible, as long as it has a decoder to decode the information delivered by the 
5 server. In one embodiment, the clients also have some form of user-interface apparatus to 
communicate the decoded information to a user. 

In one example, a client requests for an application. This can be done by a user 
activating his set-top box. He might want to get to YAHOO' s web page through his 
television. This type of application is known as an interactive application, 102 in FIG. 1 . 

10 In such an application, a user can interact with the application. This is different from just 
passively watching a STAR TREK episode on the television, because a user cannot change 
anything in the episode. Anyway, the request is transmitted to the server, which will access 
the web page. Then the server adapts the accessed web page for the television, with the 
adaptation depending on a number of factors; for example, the web page itself, such as 

15 whether the web page contains text, images, video or some combination thereof; and the 
resources available, such as the transmission medium carrying the web page to the client, 
and the capability of the client. In one embodiment, the web page is modified based on 
MPEG1 specifications and the RTP network protocols, and is transmitted through an 
Internet connection from the server to the set-top box of the television. In this case, the 

20 client is the television and the set-top box, which receives the transmitted signal, and 
decodes it. The decoded signals are typically a modified version of the original application. 
In other words, the decoded application is not exactly the same as the application in the 
server. Then the set-top box shows the web page on the television, allowing the user to 
interact with it. 

25 In another embodiment, a user initially enters his preference to the server. This can 

be the score of the LA Lakers basketball team at the end of each of their games to be shown 
on her pager screen. Such piece of information is also known as a push application, 104 
in FIG. 1 ; it is preset by the user. When a score is available, the server can deliver it to 
her pager through radio wave. Again the application can be adapted based on at least one 
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characteristic of the application itself and the resources available. 

FIG. 2 illustrates one embodiment of the server side and the client side of the 
present invention connected through a transmission medium 154. FIG. 3 shows one set 175 
of steps to implement one embodiment of the invention. 
5 In one embodiment, the server side includes an appliance-specific transducer 150 

and an adaptive-transmission transducer 152. In general terms, the appliance-specific 
transducer 150 modifies (step 177) an application based on the capability of the client; and 
the adaptive-transmission transducer 152 further modifies (step 181) the application based 
on the transmission medium 154. The modification can also depend on the application 
1 0 itself; for example, an audio signal is modified in a different way as compared to a piece 
of written text. In one embodiment, the client includes a decoder 156 and a user-interface 
158. The decoder 156 interprets or decodes (step 185) the delivered signal, which, may 
have previously been tailored to the capability of the decoder 156. Then, the user-interface 
158 presents the modified application 187 to a user. 
1 5 In one embodiment, the appliance-specific transducer 150 modifies an application 

based on at least one characteristic of the application in conjunction with the client. For 
illustration purposes, there are four different types of applications; and they are: 

(a) Document or Doc, which includes text and images in their corresponding 
formats. 

20 (b) Internet, which includes streaming multimedia and plugins. 

(c) Email. 

(d) Form, which includes different types of forms with different formats for a 
user to enter information into. 

Each of these applications has its characteristics, and can be modified differently depending 
25 on the client. 

FIG. 4 shows examples of appliance-specific transducers 150 in the present 
invention. In this specification, a term with an application appended by a client designates 
an appliance-specific transducer 150 for that application and that client. For example, a 
DocTV designates an appliance specific transducer for modifying a document for television 
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viewing. This transducer can include a number of sub-transducers, such as a format sub- 
transducer for TV to change the format of the image depending on the television. This can 
be changing the size of the text so that a user six feet away can see the text. So there can 
be one or more of such sub-transducers to adapt the application for television viewing. 
Note that television is typically watched six or more feet away, while a computer monitor 
is less than one foot away from a viewer. Other sub-transducers, depending on needs, can 
be a text sub-transducer to change the text characteristics based upon the client, an image 
sub-transducer to change the image characteristics based upon the client's display 
capabilities, and a user-interface sub-transducer to enhance the usability of the application 
on the client. The appliance-specific transducer 150 can add one or more sub-transducers 
dynamically to modify the application accordingly. 

Figure 4 shows additional examples of such sub-transducers. For example, if one 
is browsing the Web using a phone with a display, the appliance-specific transducer 150 can 
be a DocSPhone, 200, with S in SPhone denoting screen, or an InternetSPhone, 202. The 
DocSPhone is used if one is just using the phone to passively receive messages, while the 
InternetSPhone is used if one is using the phone to interact with the messages, as in 
interacting with a Web page. For another example, if one is using the phone to retrieve 
email, the appliance-specific transducer 150 can be an EmailSphone, 204, or a DocSPhone. 
The EmailSPhone,. 204, has additional intelligence in that the phone can have a software 
management system for email. As a final example, if the phone is used for electronic 
commerce or E-Commerce, the appliance-specific transducer 150 can be a FonnSPhone, 
206, which can allow a user to edit a form, as in ordering a book from the Web. 

There are different ways to produce such appliance-specific transducers 150. One 
way is based on methods and apparatus disclosed in the co-pending U.S. Patent Application 
S/N 08/970,735, filed on November 14, 1997, to generate such transducers dynamically. 
Another method can be through direct mapping. For example, a page in HTML can be 
changed or mapped directly into a bit-map. 

In one embodiment, the output from the appliance-specific transducer 150 is an 
appliance-specific output 179, which is further modified by an adaptive-transmission 
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transducer 152. 

The adaptive-transmission transducer 152, based on the characteristics of the 
application and the transmission medium 154, modifies the appliance-specific output 179 
to generate an adapted output 1 83 . In one embodiment, the compression algorithm and the 
5 network protocol to be operated on the appliance-specific output 1 79 depend on at least one 
characteristic of the application, such as the reliability or error rate of the application 
required, and the speed or bandwidth of the transmission medium 154. After the appliance- 
specific output 179 is modified to generate the adapted output 183, the server sends the 
adapted output 183 through the transmission medium to the client. 
1 0 FIG. 5 shows one embodiment of the adaptive-transmission transducer 152 of the 

present invention. It includes a multimode compressor 250 and an adaptive packetizer 252 . 
The compressor selects the appropriate compression algorithm to compress the appliance- 
specific output 179, while the adaptive packetizer 252 selects the networic protocol to 
generate the adapted output 183. 

15 

FIG. 6 shows examples of the characteristics of transmission media for the present 
invention. The different characteristics can be in the bandwidth, error rates and latency. 
Latency represents how long a client has to wait for an application. A medium with a high 
error rate implies that data going through such a transmission medium 154 tends to have 

20 more errors. To compensate for such deficiencies, an application might have to be re-sent 
to ensure the right signal has been received. This increases latency. For example, an 
analog signal, 300, transmitted through air-a wireless analog signal— has high error rate, 
302, because signal interference can be high. Since the signals might have to be transmitted 
a number of times to ensure accuracy, the latency of the signal increases, 304. Depending 

25 on the application and the transmission medium 154 to be used, the adaptive-transmission 
transducer 152 automatically takes into account such variations, for example, by selecting 
the appropriate compression algorithm and network protocol. 

In one embodiment, the multimode compressor 250 automatically selects the 
compression algorithm in view of the application, the transmission medium 154 and the 
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client. The higher the form of data to be sent from the server to the client, the lower the 
bandwidth required, but the more computation power the client has to have. For example, 
with respect to ASCII text (a higher form data) and bitmap (a lower form data), the ASCII 
text document takes less bandwidth to be transmitted, but the client needs the decoding 
5 capability to understand the ASCII text. On the other hand, if the document is sent in 
bitmap, the client displays whatever is received, but the amount of data sent increases 
significandy . If the client has the capability to decode compressed ASCII text, and if the 
transmission medium 154 has a small bandwidth, then it is better to compress the ASCII 
text before transmission. This ensures a more efficient use of the resources. 
10 In one embodiment, the parameters used to choose the compression algorithm 

include: 

(b) Input data type, whether it is text, graphics, natural images, audio or video. 
Note that the application can have a number of different input data type, 
such as there can be text and images on the same page. 

1 5 (b) Rate-distortion requirement, or the compromise between bandwidth versus 

quality. 

(c) The transmission medium 154, which affects the bandwidth, error rate and 
latency. 

(d) Capabilities of the server and the client, such as the processing power and 
20 memory available. 

A number of compression algorithms are applicable to this invention . They include 
Lempel-Ziv (LZ), Run Length Encoding (RLE), JPEG, Hierarchical Vector Quantization 
(HVQ), ADPCM, MPEG1, MPEG2, H.263 and Hierarchical Vector Quantization with 
Conditional Replenishment (HVQCR). 
25 FIG. 7 shows ways to select the compression algorithms based on the input data 

type and the computation power of the client because the decoder 156 might need to 
decompress the adapted output 1 83. Note that the computation power of the server may 
also have to be taken into account because it is the server, or the multimode compressor 
250, that is performing the compression. However, typically, the client is not as powerful 
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as the server. If the client has sufficient power to decompress, the server should have 
sufficient power to compress. 

In one embodiment, the adaptive-transmission transducer 152 not only selects the 
compression algorithm, it also selects the network protocol. This can be done by the 
5 adaptive packetizer 252. To illustrate the present invention, three protocols are considered, 
and they are TCP, UDP and RTP. 

FIGS. 8A-B show examples of network protocols selected by the adaptive 
packetizer 252 under different conditions, with FIG. 8A for low-error rates and FIG. 8B 
for high-error rates. In one embodiment, the selection again is done in an adaptive manner, 
1 0 with the choice made depending on the data type of the application and the transmission 
medium 154. For example, if the application is a piece of text and has to be accurate, then 
error rate has to be low. If the transmission medium has inherendy high latency, then as 
shown in FIG. 8A, UDP is selected. On the other hand, if the application is a video 
stream, then error rate can be high, but latency should be low because a viewer's enjoyment 
15 level drops if there are detectable gaps between frames. Based on FIG. 8B, RTP is 
selected. 

In one embodiment, the client can be ultra-thin. It only needs minimal computing 
power and memory capacity because the server has already adapted or modified the 
application for the client. Such type of clients can be very low cost. An example of a 

20 ultra-thin client is a TV set top box that is capable of handling powerful applications, such 
as streaming audio and video, Java applets and ActiveX controls. Such a box may only 
require the computing power of a 16 MHz 80386 microprocessor, with 1 Mbyte memory, 
and with embedded software that can fit into 100 KBytes memory. 

FIGS. 9A-B illustrate an example of a decision tree of the present invention for a 

25 Web browsing application 400. As shown in FIG. 9A, if the appliance or the client is a 
television 402, then the appliance-specific transducer 150 will select the sub-transducers of 
a DocTV and an IntemetTV. The output from the appliance-specific transducer 150 is 
further modified, as shown in FIG. 9B. For example, a part of the application is a piece 
of text, so the data type, 404, is text, 406. Also, the transmission medium 154, or the 
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connection 408, is wired LAN, 410, with bandwidth of 10 mega bits per second (Mbps). 
Further assume that the computing power, 412, of the appliance is low, such as less than 
10 million instructions per second (Mips). Then, following the decision tree, the adaptive- 
transmission transduer 152 will select RLE as the compression algorithm and UDP as the 
network protocol. After the modification, the output will be transmitted through the wired 
LAN to the appliance, which in this case is a television 402. 

Another embodiment of the invention includes a new type of network protocol. It 
is an application layer protocol, known as VAP. It runs on top of network protocols, such 
as the TCP, UDP or RTP. VAP includes two packet types, the Rendered Data Object 
(RDO) and the Client Data Object (CDO). RDOs are sent from the server to the client in 
response to a CDO request. 

The RDO characteristics include the following: 

(a) Each RDO packet is self-contained in that it is possible to decode and 
reproduce a portion of the output based upon each RDO separately. Such 
a feature is especially suitable to situations with high latency or high error 
rates. It also permits packets to be delivered out of order. 

(b) Each RDO packet contains complete information about the active areas of 
the screen and corresponding actions. 

(c) RDO packets contain information about the compression algorithm used. 

(d) VAP permits incremental reconstruction of the output at the client. This is 
applicable to implement smart-loading which improves the user experience 
by providing them with some data quickly. RDO packets contain 
information about the layer of the reconstruction including transparency 
information. 

The CDO characteristics include the following: 

(a) Each CDO packet contains an appliance-id, which identifies the client and 
is specified by the VAP. It is for detennining the capabilities of the client 
so as to allow the server to respond accordingly. 

(b) Each CDO packet contains an action and corresponding data. 
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One embodiment of the present invention includes an image generator, and a 
customizer to re-format a pre-determined rendition of contents, such as a Web page, into 
a new rendition, for a specific class of devices, based on preferences of content providers 
or end users or both. 

5 One embodiment of re-formatting includes three windows on a display. One 

window shows an image of the original rendition of the contents, and another window 
shows a preview of the new rendition, which can include the image of the new rendition 
as shown in a simulated image of the specific class of devices. The images can be 
generated by the image generator. The third window shows a control panel, which is a 
1 0 user-interface of the customizer, to allow a content provider or an end user to re-format the 
original rendition. 

Using the control panel, a content provider, can identify an area in the original 
rendition, and place it as a component in the new rendition. This can be done in a number 
of ways. For example, the customizer can include a section identifier and a section 

1 5 manipulator. The identifier identifies a section in the original rendition. After the section 
is identified, the manipulator copies that section, and automatically places it as a component 
in the new rendition. TTiis could be achieved through a drag-and-drop metaphor. Based 
on the section identifier, a user can navigate from section to section in the original 
rendition, such as moving from the header to the left hand column. If the user wants a 

20 particular section, the user can highlight it. The section manipulator can then automatically 
place a copy of the section into the new rendition in a foimat selected by the user. The 
format desired can be set by a function key in the control panel. For example, if the 
original format is in three different columns, by clicking a list key, contents in the columns 
are transformed into a single list to be placed in the new format. The position of the list 

25 can be set by a position key in the control panel. 

The new rendition depends on the characteristics of the specific class of devices. 
For example, if the specific class of devices is a pager, and the section selected is a title 
with a large font size on the original rendition, the font size of the title can be reduced to 
fit into the screen of the pager. 
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Once the user has finished identifying the desired sections, and generated the new 
rendition, the transformation from the original to the new rendition can be stored in a 
storage medium. In the future, similar original renditions will be transformed the same 
way to the same class of devices automatically. Similar renditions can be detected even 
when the renditions have slightly differing characteristics, such as when sections have been 
moved around, or additional sections introduced or certain sections that are irrelevant to the 
reformatting are absent. 

In the above description, the re-formatting can be under the control of a content 
provider. However, an end-user can be in control of the process, or both the end-user and 
the content provider can control the process. 

Thus, users, who can be content providers or end users, can have a pre-determined 
rendition of contents re-formatted as desired. 

Other embodiments of the invention will be apparent to those skilled in the ait from 
a consideration of this specification or practice of the invention disclosed herein. It is 
intended that the specification and examples be considered as exemplary only, with the true 
scope and spirit of the invention being indicated by the following claims. 
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CLAIMS 

1 . A computer-aided method to selectively display a pie-determined set of contents for 
a specific class of devices, the method comprising the steps of: 

generating an image of a pre-determined rendition of the set of contents; 
5 identifying a section in the contents based on a preference of a user, and 

re-formatting the identified section to generate a new rendition, depending on a 
characteristic of the specific class of devices and a preference of the user, 

such that the new rendition can be displayed on the specific class of devices. 

2. A computer-aided method as recited in claim 1 wherein the user is selected from 
1 0 the group of an end-user viewing the new rendition and the provider of the set of contents. 

3. A computer-aided apparatus to selectively display a pre-determined set of contents 
for a specific class of devices, the apparatus comprising: 

an image generator configured to generate an image of a pre-determined rendition 
of the set of contents; 

15 a section identifier configured to identify a section in the contents based on a 

preference of a user, 

a section manipulator configured to re-format the identified section to generate a 
new rendition, depending on a characteristic of the specific class of devices and a 
preference of the user; 

20 such that the new rendition can be displayed on the specific class of devices. 

4. A computer-aided apparatus as recited in claim 3 wherein the user is selected from 
the group of an end-user viewing the new rendition and the provider of the set of contents. . 



25 
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